Formal Test Automation: A Simple Experiment
نویسندگان
چکیده
In this paper we study the automation of test derivation and execution in the area of conformance testing. The test scenarios are derived from multiple specification languages: LOTOS, Promela and SDL. A central theme of this study is the usability of batch-oriented and on-the-fly testing approaches. To facilitate the derivation from multiple formal description techniques and the different test execution approaches, an open, generic environment called TorX is introduced. TorX enables plugging in existing or dedicated tools. We have carried out several experiments in testing a conference protocol, resulting in requirements on automated testing and benchmarking criteria. ∗Corresponding author: Axel Belinfante, University of Twente, Faculty of Computer Science, Formal Methods and Tools research group, P.O. Box 217, NL-7500 AE Enschede, The Netherlands, email: [email protected] This research is supported by the Dutch Technology Foundation STW under project STW TIF.4111: Côte de Resyste – COnformance TEsting of REactive SYSTEms. URL: http://fmt.cs.utwente.nl/CdR
منابع مشابه
An Informal Formal Method for Systematic JUnit Test Case Generation
The JUnit testing tool is widely used to support the central XP concept of test first software development. While JUnit provides Java classes for expressing test cases and test suites, it does not provide or proscribe per se any guidelines for deciding what test cases are good ones for any particular class. We have developed a method for systematically creating complete and consistent test cl...
متن کاملChallenges in Automated Model-Based HMI Testing
We describe our approach to automated model-based HMI testing. The paper is divided into two parts. In the first part, we summarize the current status of our work. In the second part, we describe a number of research areas that need to be worked on in order to achieve true model-based HMI test automation. 1 Test Automation in the HMI Domain The task of test automation involves two subtasks: (1)...
متن کاملAutomatic test case generation for critical embedded systems
This paper presents a research project on the feasability of automatic test generation from formal specification in an industrial context. Airbus has used SCADE for several years to specify critical avionics systems. We have experimented automated test generation tools from SCADE specifications and defined a coverage criterion adapted to SCADE specifications.
متن کاملEvaluating Evolutionary Testability with Software-Measurements
Test case design is the most important test activity with respect to test quality. For this reason, a large number of testing methods have been developed to assist the tester with the definition of appropriate, error-sensitive test data. Besides black-box tests, white-box tests are the most prevalent. In both cases, complete automation of test case design is difficult. Automation of black-box t...
متن کاملEfficient representation for formal verification of time performances of networked automation architectures
Networked automation architectures with Ethernet-based fieldbuses instead of traditional fieldbuses are more and more often used in industry, even for critical systems such as chemical or nuclear power plants. The strong safety requirements of these processes impose to evaluate the time performances of these complex architectures. Formal verification techniques are promising solutions to reach ...
متن کامل